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Abstract 

The purpose of this study is to develop a five-point likert scale called ‘Curriculum Fidelity’. For 
this purpose, a draft scale consisting of 65 items have been represented to the expert opinion 
firstly and it has been decided that 15 items should be excluded. The remaining 50 items have 
been given to 249 teachers and the maximum likelihood has been used in the factor analysis of 
the scale in order to examine the structural validity. The remaining 28 items have been grouped 
into 3 factors. The explained variance is 62,753 of the total variance. The Cronbach’s Alpha value 
is 0.94. Furthermore, item-total, item-remaining and item discrimination have been found 
significant. After exploratory factor analysis, it has been found that goodness of fit indexes are 
acceptable according to the results of confirmatory factor analysis (RMSEA= .075; CFl= .90; RMR= 
.08; GFl= .79; AGFI= .76; NNFI= .89). 

Keywords: Curriculum, Fidelity, Teachers 


Introduction 

Since the curricuulum is comprehensive and multidimensional, there are different definitions in 
educational resources about it. Differences in the definition of the curriculum are based on the 
understanding of the scientists; as they consider different dimensions of educational practices or 
they emphasize different dimensions of an approach. The curriculum is defined as a plan that 
shows all the activities that are carried out in order to create a behavioural change in the 
individual and all activities which are to carry out the aims of the national educational in an 
education institution for children, youth and adults (Erden, 1998). In addition to this definitions 
of the curriculum, Posner (1985) emphasizes the existence of several different programs such as 
the official, hidden and neglected program (Flinders, Noddings, Thornton, 1986). While the 
official curriculum which is prepared and sent to the schools is supposed to be followed, the 
effect of many variables such as differences in teachers’ practices, school infrastructures and 
students differences causes the differecences in the implementation of the curriculum and that 
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differences in the implementation of the official curriculum lead to the operational and the 
neglected curriculum. 
It is the gospel truth that the extent to which teachers are adhere to the curriculum is one of the 
main reason of the emergence of the different curriculum. Therefore, it became important to 
examine the concept of curriculum fidelity in the United States (Dikbayir and Bumen, 2016). 
Curriculum fidelity is defined as the extent to which the implementers are faithful to aims of the 
curriculum developer (Dane ve Schneider, 1998; Domitrovich ve Greenberg, 2000), and to the 
extent to which the curriculum is implemented compared the original curriculum design (Mihalic, 
2004). 
When the literature has been reviewed, it has been concluded that the extend to which the 
implementers are loyal to the original curriculum is called as curriculum fidelity Mihalic, 2004; 
Lynch ve O’Donnell, 2005; Carroll, Patterson, Wood, Booth, Rick ve Balain, 2007; Davis, 2014) and 
it has also been found that this term is generally named as either curriculum fidelity (Vartuli and 
Rohs, 2009) or implementation fidelity (Munter ve Garrison, 2010; Durkin, Pollack, Star ve Rittle- 
Johnson, 2012; Woolley, Rose, Mercado ve Orthner, 2013). 
Curriculum fidelity is defined and measured with five different dimensions (Dusenbury, 
Branningan, Falco, Hansen, 2003, O'Donnell, 2008) such as adherence, dose/duration, quality of 
delivery, participant responsiveness, and program differentiation. While it is notes that each of 
these dimensions are to be measured (Dane and Schneider, 1998), there are other studies which 
note that there is no need to measure them separately (Azano, Misset, Callahan, Oh, et al., 2011). 
These dimensions are defined as the following: 
e Adherence: To what extend the curriculum components are implemented as the official 
curriculum predict, 
e Dose/Duration: To what extend the duration, frequency and the number of the practices 
are implemented as in the official cuuriculum, 
e Quality of delivery: the ability of the teachers to prepare, to trust in him/herself, to 
communicate clearly and to answer the questions about the topic, 
e Participants responsiveness: The level of participation of the students and their interest, 
e Program differentation: how well the intervention is defined and different from the other 
ones. 
The need to measure curriculum fidelity is the main reason for understanding curriculum 
implementation, testing theoretical assumptions, interpreting findings, and ensuring feedback 
(Backer, 2001, Dane and Schenider, 1998, Domitrovich and Greenberg, 2000). Thanks to the 
measurement of the curriculum fidelity, feedback can be provided to the curriculum evaluation 
studies, as well as to the formative evaluation. From this point of view, it is very important to 
determine the level of curriculum fidelity of the teachers. This scale development study is 
important because of the lack of scales developed in this field. 


Method 
In this section, the study sample, scale development process and data analysis are explained. 
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Participants 

The study sample consists of 249 teachers who have been working in the Aegean Region of 
Turkey during the academic year of 2017-2018. There are different information in the literature 
about sample selection in scale development studies. Kline (1994) suggests that a sample of 100 
individuals may be sufficient (Cited, Pearson and Mundform, 2010). 


Scale Development Process (Exploratory Factor Analysis) 
At the beginning of the creating the item pools, the studies on the curriculum fidelity have been 
examines and the four open-ended questions have been created based on the literature. 

1) What do you think about whether a teacher should be loyal to the curriculum of 
his / her course? Please explain. 

2) In what ways do you think you loyal to the curriculum you are supposed to 
implement? (objectives, content, learning situation, evaluation, preparation for 
the course, etc.). Please explain. 

3) In what ways do you think you are not loyal to the curriculum you are supposed 
to implement? (objectives, content, learning situation, evaluation, preparation for 
the course, duration, etc.). Please explain. 

4) What are the positive or negative factors that affect your loyalty to the curriculum 
you are supposed to implement? Please explain. 

The questions have been asked to five teachers from different branches (2 English Language 
Teachers, 1 Classroom Teacher, 1 Science Teacher, 1 Technology and Design Teacher) selected 
randomly and to the three phd candidate in Curriculum and Teaching. Based on the answers of 
the open-ended questions and the literature review, 65 items have been created expressing the 
curriculum fidelity. The five point likert type instrument has been presented to expert in terms 
of scope validity and a total of six items with narrative impairment, not related to curriculum 
fidelity have been excluded from the scale. After the necessary correction the remaining items 
havebeen applied to the 14 teacher eight of which works in Afyonkarahisar, Turkey, and the 
others have been reached through the internet on a voluntary basis, and it has been decided that 
nine items have been excluded from the scale. After all the corrections, the remaning 50 items 
have been applied to 249 teachers working in Afyonkarahisar, Turkey. 


Finding of the Exploratory Factor Analysis 

The suitability of the data for factor analysis can be assessed by the KaiserMeyer-Olkin (KMO) 
coefficient and the Bartlett sphericity test. KMO and Bartlett test have been used to determine 
the suitability of the data obtained from the application of the trial scale to factor analysis and it 
has been concluded that the data are suitable for the factor analysis (KMO= .941; Barlett 
sphericity= .000). Maximum likelihood has been used for factorization techniques as it is an 
iterative process that determines the direction and magnitude of the change in coefficients 
starting with the random coefficient values for the predictor set and maximizing the probability 
of obtaining the observed frequencies (Tabachnik and Fidell, 2013: 441). Factor loading is a 
coefficient explainig the relation betwen items and factors. While the factor loading of the scale 
should be .30 and above, it is generally preferable to have a factor loading .40 or above (Tekindal, 
2015:150). In this study, the minimum value has been accepted as .40. 
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In exploratory factor analysis, while the factors are decided, eigen-value (Buyukozturk, 2014) and 
scree plot are used (Cokluk, Sekercioglu and Buyukozturk, 2014). The factors have been decided 
according to the eigen value on this study. As a result of the exploratory factor analysis, 22 items 
have been excluded from the scale and a scale consisting of 28 items and 3 sub-dimensions 
named as (1) Curriculum Practice Fidelity, (2) Curriculum Awareness, (3) External Effects to 
Fidelity. 

The Cronbach’s Alpha value of the scale is .944 (a = .942 for factor 1, a = .937 for factor 2, a = 
.818 for factor 3). If the reliability coefficient of a scale reaches .90, it can be said that 90% of the 
total variance in these scale scores is true (Tekindal, 2015: 176). The items in the 5 point Likert 
type scale have been graded as ‘Totally Agree’, ‘Agree’, ‘Neutral’, ‘Disagree’ and ‘Totally 
Disagree’. 

The eigenvalues and explained variance percentages of the factors are given in Table 1. below. 


Table 1. The Percent of explained total variance of the curriculum fidelity scale 


¥ ExtractionSums of RotationSums of 
o InitialEigenvalues SquaredLoadings SquaredLoadings 
8. x x x 
5 -| 2 oS 3 a 3 
UO oO ~ oO ~ ()) ~ 
Q & 9g & Q & 
g £| ¢ g £ FE, 8 £ E 
e| $| 38 c s é|_&| $§| 3 
1 11,348 40,529 40,529 11,348 40,529 40,529 7,883 28,152 28,152 
2 4,807 17,166 57,696 4,807 17,166 57,696 7,173 25,617 53,769 
3 1,416 5,057 62,753 1,416 5,057 62,753 2,516 8,985 62,753 


The variance explained by factor one is 40,529 %; it is 17,166 % by factor two, 5,057 % by factor 
three. The total variance explained is 62,753 %. The explained variance in this research can be 
accepted as sufficient since variance ratios between 40% and 60% are identified as ideal (Scherer, 
1988). The factor loadings of the items are given below in Table 2. 
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Table 2. Rotated component matrix table of the curriculum fidelity scale 


Components 
Items 1 2 3 
Item42 .846 
Item33 836 
Item29 835 
Item26 825 
Item13 .820 
Item9 784 
Item11 .768 
Item10 758 
Item3 733 
Item5 721 
Item6 712 
Item1 .653 
Item2 414 
Item41 842 
Item39 827 
Item40 815 
Item25 812 
Item37 805 
Item38 .766 
Item22 .736 
Item23 .726 
Item31 .689 
Item30 .680 
Item24 517 
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Item49 501 

Item7 819 
Item20 .750 
Item28 714 


As shown in Table 2. , it has been concluded that 13 items are under the ist factor, 12 items are 
under the 2nd factor and 3 items are under the 3rd factor. The factor loadings for 28 items in the 
scale range from .404 to .846. The factors of the scale are explained above: 


Factor: Curriculum Practice Fidelity 

The first factor of the scale consists of 13 items (1, 2, 3, 5, 6, 9, 10, 11, 13, 26, 29, 33 and 42). As 
a result of exploratory factor analysis, these items have been determined as 1st, 2nd, 3rd, 4th, 
5th, 6th, 7th, 8th, 9th, 10th, 11th, 12th and 13th items of the final scale. The most of the items 
in the first factor of the curriculum fidelity are about whether teachers apply the curriculum 
according to requirements, and whether they consult the curriculum or not in their practice. 
Based on this characteristic of the items in this factor, it has been named as the ‘Curriculum 
Practice Fidelity’. The minimum score is 13 and the maximum score is 65. The high scores indicate 
high fidelity and vice versa. 


Factor: Curriculum Awareness 

The second factor of the scale consists of 12 items (22, 23, 24, 25, 30, 31, 37, 38, 39, 40, 41, 49). 
As a result of exploratory factor analysis, these items have been determined as 14th, 15th, 16th, 
17th, 18th, 19th, 20th, 21st, 22nd, 23rd, 24th, 25th items of the final scale. The most of the items 
in the second factor of the curriculum fidelity are about whether teachers are familiar with the 
curriculum. Because most of the items in the this factor require awareness, this factor of the scale 
has been named as Curriculum Awareness. The minimum score is 12 and the maximum score is 
60. The high scores indicate high awareness and vice versa. 


Factor: External Effects to Fidelity 

The third factor of the scale consists of 3 items (7, 20, 28). As a result of exploratory factor 
analysis, these items have been determined as 26th, 27th, 28th items of the final scale. All the 
items under the third factor of the scale are about the external effects so this factor has been 
named as External Effects to Fidelity. All of the items in the factor are recoded into reverse value. 
The minimum score is 3 and the maximum score is 15.The high point indicate that external factors 
donot have an effect on currculum fidelity and vice versa. 


Interpretation of the Scale 

The highest score which can be taken from the scale is 140 and the lowest is 28. The high score 
from the scale indicate high curriculum fidelity and the low score indicate low curriculum fidelity. 
The results of the item analysis of the scale have been given in Table 
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Table 3. : Item analysis of the curriculum fidelity scale 


me es 

gS 5 
Item Fs Es t p 

Er mf 

=O ES 
Item 1 471 .430 7,691 .000 
Item 2 .654 .622 13,026 000 
Item 3 .613 581 10,729 .000 
Item 4 569 534 10,509 .000 
Item 5 590 558 9,065 .000 
Item 6 .621 589 11,183 .000 
Item 7 .606 574 11,256 .000 
Item 8 .627 594 11,666 .000 
Item 9 .644 .615 11,397 .000 
Item 10 572 538 10,56 .000 
Item 11 .656 .628 12,273 .000 
Item 12 .666 .637 13,026 000 
Item 13 .628 597 11,380 .000 
Item 14 .639 .600 12,686 .000 
Item 15 .613 .569 12,257 .000 
Item 16 .634 598 12,288 .000 
Item 17 .692 .656 14,900 .000 
Item 18 .670 .631 14,781 .000 
Item 19 .607 564 11,214 .000 
Item 20 714 .679 16,507 .000 
Item 21 719 .686 18,103 .000 
Item 22 .705 .671 17,568 .000 
Item 23 .656 .617 13,329 .000 
Item 24 .696 .662 15,809 .000 
Item 25 .696 .666 12,529 .000 
Item 26 559 .516 8,588 .000 
Item 27 .658 .622 12,759 .000 
Item 28 534 .487 9,362 .000 


As a result of the correlation analysis for item-total and item remaining, it has been concluded 
that there is a meaningful correlation between all the items and the scale. The result of the 
independent t-test for the high group (27%) and low group (27%) has shown that each item has 
a meaningful and significant discrimination feature. 
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Confirmatory Factor Analysis 

Confirmatory factor analysis is an analysis in which a previously defined structure has been tested 
as a model. With this analysis, it is tried to prove that the observed variables are related with 
latent variables and the the latent variables are interrelated with each others (Cokluk, 
Sekercioglu, Buyukozturk, 2014:275). A model has been created via naming the Curriculum 
Fidelity Scale. It has been decided that the factors of the scale are about practice fidelity, 
curriculum awareness and external effects, respectively and this model has been test by 
confirmatory factor analysis. The items about curriculum fidelity are a1-a13; the items about the 
curriculum awareness are a14-a25 and the items about the external effects are a26-a28. The 
subscale and the scale reliability coefficients of this model tested with DFA have been calculated. 
The path diagram of the ‘Curriculum Fidelity Scale’ has been given in Figure 1. 


Figure 1. The significance level of the latent variables’ explanation rate on the observed variables 
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Chi-Square 735.67, if 447, P=—Vveltue o,0o00000, BMMSEAwt. a7F 


T values of the latent variables for explaining the observed variables are seen on the arrows. It is 
indicated that if t values exceed 1.96; they are accepted significant at he level of .05 and if they 
exceed 2.56, they are accepted significant at level of .01 (Cokluk, Sekercioglu ve Buyukozturk, 
2014). As seen in the figure 1, all the parameter estimations are significant at the level of .01. 


Sekil 2. : The error variance of the path diagram of curriculum fidelity scale 
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The error variance of the curriculum fidelity scale has been given in Figure 2. When the items are 
evaluated, it has been concluded that item a2 and a16 have the highest error variance. It has 
been decided that all the items can be included in the model as all the t values of the items are 
significance. 


Figure 3. Results of confirmatory factor analysis 
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Table 4. CFA goodness of fit results of curriculum fidelity scale 


Fitness Indexes Proposed Fitness Criteria Acceptable Criteria 
Value 
x2 /df 2,12 0< x2 /df<2 2< x2 /df <3 
RMSEA .075 O<RMSEA <.05 .O5 < RMSEA < .08 
Comperative Fit 
eek (CFI) .90 .95 < CFI < 1.00 .90 < CFI < .95 
Standartized RMR .08 0 <SRMR s.05 .05 <SRMRs.10 
Goodness of Fit 
Indeks (GF) 19 .95 < GFI< 1.00 .90 < GFI< .95 
Adjusted 
Goodness of Fit 76 .90 < AGFI < 1.00 .85 < AGFI <.90 
Indeks (AGFI) 
NNFI .89 .95 < NNFI < 1.00 .90 < NNFI< .95 


It is stated that x2 /df value is as low as 2.0 (Tabachnik and Fidell, 2013), RMSEA value is .08 
(Browne and Sugawara, 1996), GFI value is .95 (Miles and Shevlin, 1998) shows good fitness, and 
Miles and Shevlin (1998) indicate that if GFI value is .95, it shows a good fitness. However, it is 
also indicated that GFl value can chage depend on the sample size and it should be ignored 
(Sharma, Mukherjee, Kumar ve Dillon, 2005). It is mentioned that if CFI gets closer to 1, it shows 
good fitness; and NNFI can be accepted as low as .80 (Hooper, Coughlan ve Mullen, 2008). When 
the fitness indexes of the curriculum fidelity scale model have been examined, it has been 
concluded that the values of the model are generally at the acceptable level (x2 /df=2,12; 
RMSEA=.075; CFI .90; RMR= .08 ve GFl=.79). These values confirm the factor structure. 


Conclusion and Discussion 

In this study, a scale has been developed to measure the curriculum fidelity level of the teachers. 
For this reason, a 5-point Likert-type draft scale consisting of 65 items has been prepared based 
on the literature, expert opinion and answers to the open-ended questions directed to teachers. 
This draft scale has been first presented to the expert opinion and 6 items have been excluded 
from the draft in line with the feedback from the experts. Furthermore, 9 more items have been 
also excluded from the draft scale after the pilot application to understand whether there are 
any items which cannot be fully understod or not servet he purpose of the scale. Structural 
validity has been tested with the remaning 50 items. 

First of all, exploratory factor analysis has been carried out. As a result of the analysis, it has been 
concluded that KMO value (.941) and the Barlett test result (jp<.05) have shown that the data are 
suitable for the factor analysis. Factor loading has been decided as .40 and the items which have 
a value under .40 and take place under more than one factor have been decieded to exclude 
from the scale. 22 items that have not met the criteria have been excluded from the scale and it 
has been concluded that the scale consists of 3 different factors and explains 62.75% of the total 
variance. 
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The first factor of the scale (Curriculum Implementation Fidelity) explains the 28,152 % of the 
total variance; and the second factor (Curriculum Awareness) explains the 25,617 % of the total 
variance and the last factor of the scale (External Effects to Fidelity) explains the 8,985 of the 
total variance. Item analyses (item remainig correlation, item total correlation and item 
discrimination) have been also conducted and it has been concluded that all the items have 
meaningful correlation and the the item discrimination is also statistically significant. The 
Cronbach's Alpha of the scale has been calculated as .944. 

Confirmatory factor analysis has been also employed after the exploratory factor analysis. As a 
result of this analysis, it has been concluded that the fit indexes of the scale are x2 /df=2,12; 
RMSEA=.075; CFI .90; RMR= .08 ve GFI=.79. In spite of not indicating a perfect fit, these values 
are within acceptable limits and close to acceptable limits. 

It is stated that the curriculum fidelity is composed of five dimensions and these dimensions 
measure the fidelity together (Dane and Schneider, 1998). Considering the ‘Curriculum 
Implementation Fidelity’ and ‘Curriculum Awareness’ factors of the developed scale, both of the 
factors reflect the features of these dimensions of the curriculum fidelity. In the first dimension 
of the scale, the item 9 stating that ‘I allocate the stated time in the curriculum for each objective.’ 
is in accordance with dose/duration dimension of the curriculum fidelity. Moreover, in the 
second factor of the scale, the item 22 ‘lam aware of the philosophical, psychological, social and 
individual foundations on which the curriculum is based’ is related with the program 
differentation dimension which means how well the intervention is defined and different from 
the other ones (Pence, Justice ve Wiggins, 2008). Besides, the item 15 ‘I can answer the questions 
about the objectives within the curriculum clearly and sufficiently’ and the item 19 ‘I am aware 
of the task the teacher has during the curriculum implementation.’ are two examples for the 
quality delivery, the ability of the teachers to prepare, to trust in him/herself, to communicate 
clearly and to answer the questions about the topic, and for the participants responsiveness, the 
level of participation of the students and their interest (Dusenbury, Branningan, Falco, Hansen, 
2003;0’Donnell, 2008; Pence, Justice ve Wiggins, 2008). 

In our country, while the factors that may have an impact on curriculum fidelity are considered, 
the factors such as socio-cultural structure, centralization and exams that determine student's 
future are also mentioned (Bumen, Cakar and Yildiz, 2014). In our country, the factor that is 
thought to have the biggest effect on the curriculum fidelity is the central examinations. 
Accordingly, the items under the third factor of the scale ‘The External Effects to Fidelity, aim to 
reveal the extent to which the exams affects the curriculum fidelity. 

As a result of the analyses, it can be accepted that Curriculum Fidelity Scale is a valid and reliable 
measurement tool. 

As it is a progressive procedure to develop and evaluate a curriculum, it is vital to give feedbacks 
to the system systematically. This scale is useful for both to reveal the fact that to what extend 
the teachers adopt the implemented currciulum, and what hinders their fidelity to it as well as 
contributing to all partners that are in the curriculum development and evaluation process. As 
there are few scale on the curriculum fidelity, this scale will play an important role in providing 
quantitative data to the researchers and legislatures in the field of education especially in 
curriculum and instruction. 
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